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1. Introduction 

Consider the moduli space A g of principally polarized abelian varieties of dimension 
g which are defined over an algebraically closed field k of characteristic p. There are 
several important stratifications of A g which characterize the p-torsion of the corre- 
sponding abelian varieties. Very little is known about how these strata intersect the 
Torelli locus of Jacobians of curves. It is an open question whether the Torelli locus 
intersects these strata and, if so, the extent to which the intersection is transversal. 
In particular, one can ask which group schemes occur as the p-torsion Jx[p] of the 
Jacobian Jx of a curve X of genus g. 

The p-rank fx is the one invariant of Jx [p] for which this question is moderately 
well-understood. Recall that fx — dimf p Hom(/j, p , «/x[p]) where the group scheme 
fi p is the kernel of Frobenius on G m . One can often compute the p-rank of a fixed 
curve X for a fixed prime p, e.g., 25j when X is hyperelliptic. It was recently proven 
that there exist smooth curves of genus g with every possible p-rank |SJ Thm. 2.3]. 
Likewise, there exist smooth hyperelliptic curves of genus g with every possible 
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p-rank, [8, Thm. 1] for p > 3 and [26[ Thm. 3] for p = 2. 

It is now natural to try to classify the group schemes which occur as the p-torsion 
for a smooth fc-curve of genus g and p-rank /. These are of the form (Z/p©/z p )^ ©G 
where there are 2 9 ~f~ 1 possibilities for G if / < g — 1 [11117] . One can sometimes 
distinguish these by the a- number ax = dimfcHom(a p , Jx[p\) where a p is the kernel 
of Frobenius on G a . Among these, there is a unique choice of G with a- number 1, 
which we denote I g -f- Precisely, I g -f is the unique symmetric BTi group scheme 
of rank p 2 ( g ~f>, p-rank 0, and a-number 1. For example, Ii is the p-torsion of 
a supersingular elliptic curve. The group scheme I2 occurs as the p-torsion of a 
supersingular non-superspecial abelian surface. 

In this paper, we conjecture that the curve corresponding to the generic point 
of any component of the locus in Ai g of smooth curves of genus g with p-rank / 
has group scheme Jx[p] — (Z/p © H P Y © I g -f and thus a-number 1 for / < g — 1. 
It is easy to see that this conjecture is true when / = g — 1. When / = g — 2 and 
/ = g — 3, we prove the conjecture along with some other results. The results are 
stated more precisely in the paper in terms of the dimension of the intersection of 
loci of Ai g and TL g but they imply the following. Suppose g > 3. 

Theorem I4.lt There is a family (with dimension 3g — 5) of smooth curves of 
genus g with p-rank g — 2 and a-number 1. 

Theorem 14.21 If p > 3, there is a family (with dimension 2g — 3) of smooth 
hyperelliptic curves of genus g with p-rank g — 2 and a-number 1. 

Theorem 14.31 There is a family (with dimension 3g — 6) of smooth curves of 
genus g with p-rank g — 3 and a-number 1. 

Corollary 14.51 If p > 5, there is a family (with dimension 3g — 6) of smooth 
curves of genus g with p-rank g — 2 and a-number two. 

Proposition 14.91 For p > 3 and g odd, g ^ 1 mod p, and g > 6(p — 1) all four 
possibilities of group scheme occur as Jx [p] for a smooth curve X of genus 
g and p-rank g — 3. 

The proofs are by induction on g with the quantity r — g—f fixed. The induction 
result works for any value of r. It involves the computation of the dimension of 
certain components of the boundary of A4 g . For the initial case of the induction 
process, one needs results about the locus of curves of genus r with p-rank 0. At 
the moment such results are known only when r < 3. For example, we could prove 
the conjecture when / = g — 4 with more information about smooth curves with 
genus r = 4 and p-rank 0. 

Here is an outline of the paper. Section [5] contains background. The inductive 
result is in Section [3] The results for large p-rank are in Section 2] In Section [5l we 
explain the limitations of the inductive approach used in this paper and show that 
some of the hypotheses of the results are necessary. 
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One can interpret the results of this paper as evidence that the Torelli locus 
is in general position relative to the stratification of A g by p-torsion type. This 
positioning should not be taken for granted, e.g., :23J. The theory of tautological 
classes may play a fundamental role in investigating these questions further, |22j . 
Finally, we note that not all group schemes occur for small p, e.g., |20|21j . or for 
curves with nontrivial automorphism group, e.g., |2l4j . 

2. Background 

2.1. Moduli spaces 

Let k be an algebraically closed field of characteristic p > 0. Let M g (resp. TL g ) 
denote the moduli stack of smooth projective irreducible (resp. and hyperelliptic) 
fc-curves of genus g. Let A g denote the moduli stack of principally polarized abelian 
varieties of dimension g over k. We assume g > 2 to avoid trivial cases. Recall that 
Ai g has dimension 3g — 3 and Ti. g has dimension 2g — 1. 

These moduli stacks have natural compactifications M. g (resp. TL g ) whose points 
parametrize stable (resp. and hyperelliptic) curves of genus g. Consider also the 
toroidal compactification A g of A g [7]. Then M g , H g , and A g are smooth proper 
algebraic stacks. By [24], a smooth stack has the same intersection-theoretic prop- 
erties as a smooth scheme. In particular, since k is algebraically closed, we have 
the following intersection property: if two closed substacks of M. g (or Tt g , or A g ) 
intersect then the codimension of their intersection is at most the sum of their 
codimensions. 

Without further comment, a (generic) point means a (generic) geometric point. 
We identify a curve with the point of A4 g corresponding to its isomorphism class 
(and likewise for 7i g and A g ). 

2.2. The p-rank and a-number 

Let X be a fc-curve of genus g. The Jacobian Jx of X corresponds to a fc-point 
of A g . The p-torsion Jx [p] is a group scheme of rank p 2g . Recall that the group 
scheme /j, p is the kernel of Frobenius on G m and the group scheme a p is the kernel 
of Frobenius on G a . 

Two invariants of the p-torsion of an abelian variety are the p-rank and a- 
number. Let fx = dimF p Hom(/^ p , Jx [p]) be the p-rank of X. Then < fx < 
Let ax — dimfeHom(a p , Jx [p]) be the a-number of X. Then < ax < g — fx- 
The p-rank can only decrease under specialization, while the a-number can only 
increase. 

Given g and / such that < / < g, let V g j denote the closed substack of M g 
consisting of curves X of genus g with fx < f ■ The locus V g j is pure of dimension 
2g - 3 + / by [6, Thm. 2.3]. Also V gJ n H g is pure of dimension g - 1 + / by 8, 
Thm. 1] when p > 3 and by [551 Thm. 3] when p = 2. In other words, V g j has 
codimension g — f in A4 g and in Tt g . 
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In particular, the generic point X of A4 g or of 7i g has fx = g, and thus ax = 
and Jx [p] = (Z / 'p® fi p ) 9 '; a curve with these attributes is ordinary. The non-ordinary 
locus Vg i9 -i has codimension one in 7W 9 and in H g . The generic point X of each 
component of V g:9 -i and Vg. g _i (~l 7i g has fx = 3 — 1 ; and thus ax = 1 and 
Jx"[p] — (Z/p© /ip) 9 ^ 1 ® I\; a curve with these attributes is almost ordinary. Here 
7i is the p-torsion of a supcrsingular elliptic curve (see Example 13. 2p . 

Let T Sj0 denote the closed substack of M. g consisting of curves X of genus g with 
ax > a. The results above show that T g $ has codimension in M. g (resp. H g ) and 
T g i has codimension 1 in M. g (resp. Ti. g ). There are not many other results about 
the intersection of T S)0 with M. g or TL g . This paper includes a result for a = 2. 

Finally, let V ^ (resp. T' g 2 ) denote the closed substack of A g consisting of abelian 
varieties with p-rank at most / (resp. a- number at least two) . 

2.3. Group schemes 

The results in this paper can be expressed in terms of the p-rank and a-number, or 
in terms of the isomorphism class of the p-torsion, which is a group scheme. These 
group schemes were classified by Kraft (unpublished) [11] and independently by 
Oort [17] . Together with Ekedahl, Oort used this classification to stratify A g . Here 
is a brief explanation of this topic. A more complete historical and mathematical 
description can be found in |13|17|18j . 

The group schemes G which occur as the p-torsion of a principally polarized 
abelian variety defined over k are symmetric BTi group schemes (short for truncated 
Barsotti-Tate group of level 1). A BTi is a finite commutative fc-group scheme anni- 
hilated by p having actions by semi-linear operators Frobenius F and Verschiebung 
V that satisfy certain properties, see [17l 2.1]. 

The isomorphism type of a symmetric BTi group scheme G can be encapsulated 
into combinatorial data. If G has rank p 2g , then there is a final filtration N\ C N% C 
. . . C N2 g of the covariant Dieudonne module of G which is stable under V and 
F" 1 with rank(iVi) = p l [17, 2.2]. The Ekedahl-Oort type of G is [v x , . . . , v g \ where 
p Ui = rank(V(iVj)). There are some conditions on the filtration: e.g., j^+i <Vi + \ 
[171 Lemma 2.4]. The p-rank is max{i | vi = i} and the a-number is g — v g . 

Using this combinatorial data, one can see that there are 2 s isomorphism types 
of symmetric BTi group schemes of rankp 29 and that 2 9 ~f~ 1 of these havep-rank /. 
There is a stratification of A g by Ekedahl-Oort type. The dimension of the stratum 
of A g whose points have Ekedahl-Oort type [v\, . . . , v g ] is J2i=i v i [13 Thm. 1.2]. 

2.4. The boundary of M. g and Hg 

The boundary M g — M g consists of components A and Aj for integers 1 < i < g/2. 
Each boundary component has codimension 1 in M. g . The boundary component Ao 
will be useful in the next section. 

The generic point of Ao corresponds to the isomorphism class of an irreducible 
curve Xq with one ordinary double point P' . The normalization of Xq is a smooth 
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curve Xq of genus g — 1, and the inverse image of P' consists of two distinct points 
Pi, P2 of Xq. Recall that Jx' a is a semi-abelian variety which is an extension of Jx 
byatorus, [H pg. 246]. This torus contains a copy of \i v . It follows that fx 1 — /x +l- 
Also a x > = a Xo ■ 

Likewise, if p > 3, the boundary H g — H g consists of components Ao and Aj 
for 1 < i < g/2. Each boundary component has codimension 1 in TL„. A singular 
hyperelliptic curve is a curve X corresponding to a point of 7i g — TL g . If X' G Ao 
is hyperelliptic, then so is its normalization Xq and the two points Pi and Pi are 
exchanged by the hyperelliptic involution. 

A complete substack of M. g = A4 g — Ao has codimension at least g [31 pg 80] [12], 
see also [BJ 2.4]. For p > 3, a complete substack of H g — H g — A has codimension 
at least g 2.6] In other words, if L is a closed substack of codimension less than 
g in either A4 g or H. g then L intersects Ao. 

3. Conjecture and Inductive Result 
3.1. Description of some group schemes 

The group scheme I r found in the next lemma plays an important role in this paper. 

Lemma 3.1. For r G N + , there is a unique symmetric BTi group scheme with 
rank p 2r , p-rank 0, and a-number 1. It has Ekedahl-Oort type [0, 1, . . . , r — 1]. We 
denote this group scheme by I r . 

Proof. This is proved in (THl Lemma 3.1]. For the convenience of the reader, here 
are a few details of the proof. Let I r be a symmetric BTi group scheme with rank 
p 2r , p-rank 0, and a-number 1. It is sufficient to show that the Ekedahl-Oort type 
of is uniquely determined. 

The p-rank condition implies that V acts nilpotently on I r , so v\ = 0. The 
a-number 1 condition implies that r — 1 is the dimension of V 2 I r , so v r = r — 1. 
The numerical conditions Vi+i < v>i + 1 from [17| Lemma 2.4] imply that there is a 
unique possibility for the Ekedahl-Oort type of I r , namely [0, 1, . . . , r — 1]. □ 

Example 3.2. The group scheme Ji occurs as the p-torsion of a supersingular 
elliptic curve. By JSJ Ex. A. 3. 14], I\ fits into a non-split exact sequence of the form 
— > a p — > I\ — > a p — > 0. The image of the embedded a p is unique and is the kernel 
of both Frobenius and Verschiebung. 

Example 3.3. The group scheme I2 occurs as the p-torsion of a supersingular non- 
superspecial abelian surface. By [§1 Ex. A. 3. 15], there is a filtration Hi C if 2 C I2 
where Hi = a p , H2/H1 = a p ffi a p , and I2/H2 — ot p . There is an exact sequence 
— > Hi — > Gi © G2 — * if 2 — > where Gi (resp. G2) is the kernel of Frobenius 
(resp. Verschiebung). Also Gi C if 2 and G2 G if2- The p-rank of i2 is zero since 
Hom(p p , i 2 ) =0. The a-number of i2 is one since ker(\^ 2 ) = Gi © G2 has rank p 3 . 
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Remark 3.4. One can also describe group schemes using the theory of covariant 
Dieudonne modules. Briefly, let a denote the Frobenius automorphism of k. Consider 
the non-commutative ring E — k[F, V] with the relations FV = VF = p and FX — 
X a F and AV" = VX a for all A G k. There is an equivalence of categories between 
BTi group schemes G and finite left £?-modules D(G) The covariant Dieudonne 
module for the group scheme is E/E(F r — V r ) [TS1 Lemma 3.1]. 

Here are a few facts about the Ekedahl-Oort strata of A3. First, there are four 
possibilities for the isomorphism class of a symmetric BTi group scheme G' with 
rank p 6 and p-rank 0: (i) G' = I 3 ; (ii) G' = I 3>2 ; (iii) G' = 7 2 © If, and (iv) 
G' = (Ji) . Here ^3,2 is the symmetric BTi group scheme of rank p 6 , p-rank 0, and 
a-number 2 which is not I 2 ffi I\. One can show that ^2 has Ekedahl-Oort type 
[0,1,1] and covariant Dieudonne module E/E(F - V 2 ) ®E/E(V - F 2 ) [151 Lemma 
3.4]. The group scheme I3 is the only one of the four with a-number 1. 

Secondly, here is a useful lemma about the a-number 2 locus of ^3. 

Lemma 3.5. In A3, every component 0/T3 2 has dimension 3 and every component 
of V 3 ' H T3 2 has dimension 2. 

Proof. Consider the Ekedahl-Oort types occuring in dimension three with a- 
number at least 2, namely v\ = [1, 1, 1], v 2 = [0, 1, 1], ^3 = [0, 0, 1], and v± = [0, 0, 0]. 
For each of these types u, let L„ be the locus of ^.3 of abelian threefolds with 
Ekedahl-Oort type v. By [T71 Thm. 1.2], each of these loci L u is non-empty and 
quasi-affine; all components of L v have the same dimension, which is respectively 
3, 2, 1, and 0. The only types that occur under the additional restriction of having 
p-rank are 1/2, V3, fi- 

By [13 Prop. 11.1], if 1 < i < 3, then I„ i+1 is in the closure of L Vi in ^3. Thus 
the generic point of every component of T3 2 is contained in I Ul and the generic 
point of every component of V 3 ' PI T 3 2 is contained in L V2 . Thus every component 
of T3 2 has dimension 3 and every component of V 3 ' Pi T 3 2 has dimension 2. □ 

3.2. Conjecture 

Conjecture 3.6. let < / < g. let X be the generic point of any component 
of V gJ n M g (resp. V gJ n H g for p > 3). Then J x [p] = (Z/p © fi p ) f © I g - f . 
Equivalently, a generic smooth (resp. and, for p > 3, hyperelliptic) curve of genus 
g and p -rank f has a-number 1. 

The motivation for Conjecture 13.61 is that a generic point of V ^ has a-number 
1 by [IT]- If Conjecture 13.61 is true for V g j (~l Tt g then it is true for at least one 
component of V g j H M g . The hypothesis p > 3 is necessary for the hyperelliptic 
case, see Section [531 
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3.3. Inductive result 

Proposition 3.7. Suppose g > 3 and 1 < / < g. Suppose g' is an integer such 
that g-f<g'< g. Let f' = g'-(g-f). 

(1) If Coniecture \3.6\ is true for V g > j> n M. g ' then it is true for V g j fl M g - 

(2) Ifp > 3 and if Conjecture ] 3. 6\ is true for V g > j> C\H g ' then it is true for V g j C\7i g . 

Proof. The proof is by induction on g with the quantity r = g — / fixed. Note that 
g — / = g' — f . Without loss of generality, one can take the inductive hypothesis 
to be that Coniecturc 13.61 is true when g' = g — 1 and /' = / — 1. 

(1) Let X be the generic point of a component T of V g j fl M. g - Now, dim(T) = 

2 5 -3 + /and dxm(V g j-i C\M g ) = 2 5 -4 + /by [6, Thm2.3]. Thus fx = /• 
If a x > 2, then F C T g #. Let T be the closure of L in M g . Then 
codim(r,!Mg) < g since / > 1. By 3, pg 80] and [12], T intersects A . 
Since Ao has codimension 1 in Ai g , by Section I2TT1 

dim(r) < dim(F 9 ,/ n T 3 , 2 n A ) + 1. 

A generic point of VgjHTg^nAo corresponds to a smooth curve Xq of genus 
g — 1 with 2 points identified in an ordinary double point. Also fx a = / — 1 
and ax > 2. Thus, 

dim(F s>/ n T g . 2 n A ) = dim(F g _i,/_i n T g _ h2 n M g -i) + 2. 

By the inductive hypothesis, the generic point of each component of 
V g — i (~l .M s — i has o-number 1. It follows that 

dim(^ g _ 1 , / _ 1 n T g _ ia n M g ^) < 2(g - 1) - 3 + (/ - 1). 

Then dim(T) < 2g + / — 3 which is a contradiction. Thus ajc = 1 and 
J x [p] = (Z/p®Hp) f ®I g -f by Lemma O 

(2) The proof is similar to part (1). Let X be the generic point of a component T 

of V g j n Kg. Then dim(r) = g - 1 + / and fx = f by 18, Thm. 1]. By 
Lemma 2.6], F intersects Ao when p > 3. If ax > 2, then 

dim(r) < dim(?? 9 n V g j n T g , 2 n Ao) + 1. 

A generic point of the latter corresponds to a smooth hyperelliptic curve 
Xq of genus g — 1 with 2 points identified. These two points form one orbit 
under the hyperelliptic involution. Also fx — f ~ 1 an d a x > 2. Thus, 

dim(W 9 n Vgj n r 9! 2 n A ) - dim(W s _! n n T 9-i,2) + 1- 



By the inductive hypothesis, dim(W g _i (~l Vg_ij_i (~l T^-i^) < 9 — 3 + /, 
which yields a contradiction. □ 
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4. Results for the Case of Large p-Rank 

This section includes results about the group schemes which occur as the p-torsion 
of Jacobians of smooth curves of genus g and p-rank / when / is large relative to 
g. For p-rank / = g, the only group scheme possible is (Z/p © p p ) 9 and this occurs 
for the generic point of M g and 7i g . For p-rank / = g — 1, the only group scheme 
possible is (Z/pffi Pp) 9 ' 1 ffi/i and this occurs with codimension one in M. g and H g . 

If r = g — f > 1, there are 2 r_1 possibilities for the group scheme Jx[p] of a 
smooth curve with p-rank /. By the inductive process in Section [31 the existence 
of curves of genus r and p-rank can yield results about curves of genus g with 
p-rank g — r. The situation when r < 3 is well understood due to the fact that 
dim(yW r ) = dim(^4 r ) in these cases. We amalgamate these ideas to deduce results 
when / = g — 2 and / = g — 3. 

As / decreases relative to g, the situation becomes more difficult to study. This is 
true first because there are an increased number of possibilities for Jx [p] and second 
because of the increase in codimension of the relevant loci in M g , see Section [5~T1 

4.1. The conjecture is true for M. g and H. g when f — g — 2 

Suppose g > 2 and / = g — 2. Then Jx \p] is isomorphic to either (Z/p © P P ) 9 ~ 2 © h 
or (Z/p©/i p ) s-2 ©(7i) 2 , which have a-number 1 and 2 respectively. The next results 
imply that the locus of curves with p-rank g — 2 and a-number 1 is non-empty with 
codimension 2 in M g and in Ti g . 

Theorem 4.1. The group scheme (Z/p©/x p ) s_2 ®I% occurs as the p-torsion of the 
generic point of every component ofV 9l g-2 nM 9 . So, there is a family of dimension 
3g — 5 consisting of smooth curves of genus g with p-rank g — 2 and a-number 1. 

Proof. Every component of V2,o ^ M-i has dimension 1. There are only finitely 
many points of A2 with a-number 2 [101 Thm. 2.10]. Thus the generic point of each 
component of V^o nM.2 has a-number 1, and group scheme I2 by Lemma [3~T1 This 
means that Coniecture 13.61 is true for V^o H A^2- The result for V g . g -2 H Ai g then 
follows from Proposition 13 . 7f 1 ) . □ 

Theorem 4.2. Let p > 3. The group scheme (Z/p © u p ) 9 ~ 2 ffi I2 occurs as the 
p-torsion of the generic point of every component of V g , g -2 H TC g . So, there is a 
family of dimension 2g — 3 consisting of smooth hyperelliptic curves of genus g with 
p-rank g — 2 and a-number 1. 

Proof. The proof is the same as for Theorem 14.11 and uses Proposition 13. 7f 2) . □ 

4.2. The conjecture is true for AA. g when f — g — 3 

Suppose g > 3 and / = g — 3. The next result is that the locus of curves with p-rank 
g — 3 and a-number 1 is non-empty with codimension 3 in M. g . 

Theorem 4.3. The group scheme (Z/p©/z p ) s_3 ffi/3 occurs as the p-torsion of the 
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generic point of every component ofV g _ g -zf^M g - So, there is a family of dimension 
3c? — 6 consisting of smooth curves of genus g with p-rank g — 3 and a-number 1. 

Proof. Every component of V^o H M. g has dimension 3 and its image in ^3 under 
the Torelli map also has dimension 3. On the other hand, dim^' n T3 2 ) = 2 by 
Lemma 13.51 Thus the generic point of each component of V^o H M. g has a-numbcr 
1, and group scheme 23 by Lemma [3~T1 Thus Conjecture 13.61 is true for V^o H M3. 
The result follows from Proposition 13. 7( 1). □ 

Remark 4.4. In [Ml Cor. 3.2], for any finite field k of characteristic 2, the authors 
calculate the number of /c-isomorphism classes of curves of genus 3 with a given 
Newton polygon. From the data one sees that V^o H M3 is irreducible when p = 2. 

4.3. The case of p-rank g — 2 and a-number 2 

Suppose g > 3 and / = g — 2. In this section, we consider the group scheme 
(Z/p © Mp) 9-2 © (^i) 2 - The next result shows that the locus of curves with this 
group scheme has codimension 3 in A4 g for g > 3. 

Corollary 4.5. Let g > 3. 

fij TTie group scheme (Z/p© fi p ) 9 ~ 2 © (ii) occurs as the p-torsion of the generic 
point of every component of T g ^ H .M g . 
If P > 5, f/iere is a family of dimension 3g — 6 consisting of smooth curves of 
genus g with p-rank g — 2 and a-number 2. 

Proof. 

(1) Let T be a component of T ffj 2- The generic point X of T has 2 < ax < 9 — fx- 
Since (Z/p © p p ) s_2 © (-Z1) 2 is the unique symmetric BTi group scheme of 
rank p 2g , p-rank g — 2, and a-number 2, it suffices to show that /x = g — 2. 

The result is true when g = 3. To see this, recall from Lemma 13.51 that 
every component of T3 2 has dimension 3 with generic point having p-rank 
1 and a-number 2. The same is true for T since its image under the Torelli 
morphism is a component of T' g 2 . 

The proof is now by induction on g. Let g > 4. Now codim(Tg 2 , A g ) = 3. 
Consider the intersection of T' g 2 with the Torelli locus r in A g . By Section 
[2~T1 codim(T^ 2 riT,34 fl ) < codim(r, A,) + 3 which yields codim(r, A7 g ) < 3. 
Then codim(r, ~M g ) = 3 by Theorem gT] 

Since 3 < g, Lemma 2.6] implies T intersects Ao. If Jx[p] ¥ (Z/pffi 
Pp) 9 ~ 2 © (A) 2 then fx < g - 3 and X e ^-3 n T g<2 . One checks that: 

dim(y g , 9 _ 3 n r) < dim(V^ s _ 3 n T 9 , 2 n A ) + l and 
dim(F g , s _ 3 n T 5 , 2 n A ) = dim(F ff _!, 9 _ 4 n T fl _i, 2 n A4 9 -i) + 2. 
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By Theorem l4.3| the generic point of every component of Vg-x t9 -i nM r i 
has a- number 1. Thus 

dim(F s _i, 9 _4 n r 9 _i >2 n M g -i) < dim(y s _ 1 , 9 _ 4 n M g -i) = 3g-9. 

Then dim(Vg ig _3 fl T) < 3g — 6 which is too small to be generic in T. Thus 
X must have group scheme (Z/p © Mp) 9-2 © (^i) 2 - 
(2) If p > 5, there exists a smooth curve X of genus 5 with p-rank g — 2 and 
a-number 2 by [SI Cor. 4]. The result follows since there is at least one 
component of T g ^ which is not contained in the boundary of M g . □ 

Remark 4.6. There is an explicit formula for the number of smooth curves X of 
genus 2 with fx = and ax = 2; these curves exist for all p > 5 [101 Section 3.3]. 

Remark 4.7. For each i such that 1 < i < g/2, there is a component of T gi 2, 
having dimension 3<? — 6, which is contained in the boundary component of M g . 

4.4. The case of p-rank g — 3 and a-number at least 2 

Suppose g > 3 and / = g — 3. Recall that if X E V g ^ g -z, then Jx[p] — (^/p © 
Pp) 9 ^ 3 ©G' where there are four possibilities for G': (i) G' = -Z3; (ii) G' = J3 2; (hi) 
G' = I2 © h; and (iv) G' = (ii) 3 . By Section |43| case (i) occurs for the generic 
point of every component of Vg jff _3 n M g - This section includes partial results on 
the other three cases. 

Lemma 4.8. 

(ii) For p > 2, there exists Y g M3 with Jy[p] = h,2', 
(Hi) For p > 3, there exists Y G with Jy[p] = h © Ii! 
(iv) For p > 3, there exists Y e M3 with Jy[p] — (h) 3 ■ 

Proof. 

(ii) The locus of points of A3 with p-torsion ^2 has dimension two. Let A be an 
abelian threefold with A[p] = 1^^. By the Torelli theorem, A = Jy for some 
curve Y of genus 3 with p-rank 0. Now Y ^ Aq since Jy is an abelian variety 
with no toric part. Since ^3,2 is indecomposable as a symmetric BTi group 
scheme [TSj Lemma 3.4], Jy cannot be the product of abelian varieties of 
smaller dimension. Thus Y ^ Ai by [H pg. 246]. Thus Y is smooth and so 
Y e M 3 - 

(hi) By part (iv), there exists Y' e M3 with Jy>[p] = (Ii) 3 - The Torelli locus is 
open in .A3 and contains Jy by definition. By [171 Prop. 7.3], there exists 
an irreducible dimension one sublocus L C ^3 such that Jy £ L and 
such that the generic point rj of L has group scheme I2 ffi I\. It follows 
that r\ is contained in the Torelli locus. Thus there exists Y £ .M3 with 
Jy[p] = h®h. 
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(iv) This is proved in [T6l Theorem 5.12(1)]. □ 

Proposition 4.9. Let p > 3. Suppose g is odd, g ^ 1 mod p, and g > 6(p — 1). 

Then there exists a curve X G V g . g s R M. g so that Jx[p) — (^/p © ^p) 9 ~ 3 © G' m 
eac/i o/ the three cases: (ii) G' = 13,2/ (Hi) G' = I2 ® Ii! and (iv) G' = ■ 

Proof. By Lemma T4.81 there exists a curve Y G M3 with Jy[p] = G' if (ii) G' = 
I 3>2 ; (in) G' = I 2 © h; or (iv) G' = (h) 3 . In each case, /y = 0. 

Let I = (g - l)/2. By hypothesis, p f £ and £ > 3(p - 1). By [H Thm. 4.3.1], 
under these two conditions on £, there exists an etale cyclic Z/£-cover X — > V so 
that fx — fy — 9x — 9y- By the Riemann-Hurwitz formula, = 1 + 2€ = Thus 
/x = .9 x — 3. Finally, X dominates Y so Jy[p] C Jx[p], completing the proof. □ 

Proposition 4.10. Let p = 2. Suppose g = 1 mod 4 and g > 7. T/iera t/iere exists 
a curve X e V^, s _ 3 n X 9 so t/iat J x [p] = (Z/p © Mp) 9 " 3 © ^3 : 2- 

Proof. The proof is almost identical to that of Proposition 14.91 □ 

5. Questions and related results 

5.1. Limitations of the boundary approach 

The inductive process of Section [3~3l allows one to deduce results about V g j (~l M. g 
from results about T^,o H Al r where r — g — f . This produced results when r < 3. 
Unfortunately, not much is known about V r fl C\A4 r if r > 4. One might ask whether 
the boundary of V r .o D M. r could be used to deduce more information. Here are 
some reasons why this is not straightforward. 

First, V r fi does not intersect Ao- This is because the Jacobian of every curve in 
Ao has a toric part and so has p-rank at least 1. 

Second, the intersection of V r ^o with the boundary component Aj is not useful 
for 1 < i < g/2. The generic point of Aj corresponds to the isomorphism class of 
a singular curve X with two irreducible components and X g ^, of genus i and 
g — i, intersecting in an ordinary double point. Then Jx[p] — Jxtlp] © ^x s _Jp] [B 
pg. 246]. If X G V,.^ n Aj, then fx x = fx 2 = and ax = ax x + «x 2 > 2. In other 
words, there are no singular curves with p-rank and a- number 1, which makes it 
difficult to determine whether a component of V r $ has a-number 1. 

One might also ask whether boundary methods could be used to deduce results 
about strata of Ai g other than the p-rank strata. For example, Corollarv l4.5l is about 
the strata T g ^ n M g . This becomes progressively more difficult for group schemes 
of rank p 2g and p-rank / as g — f increases. The first reason is that the number of 
possibilities for these group schemes increases exponentially in the quantity g — f. 

The true difficulty, however, is geometric; for some of these group schemes G, 
the locus Lq of curves X with Jx [p] — G is expected to have large codimension in 
M g . However, to guarantee that the closure of this locus intersects the boundary 
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component Ao of A4 g , one requires that the codimension be less than g. The base 
cases of the induction process thus involve curves of genus even larger than r = g—f. 

For example, consider the group scheme G = (Z/p©/x p ) 9_3 ©(7i) 3 . The locus Lq 
is expected to have codimension 6 in M. g . Thus, to produce curves with / = g — 3 
having group scheme (ii) 3 , one would need to start with results for curves of genus 
6. This was avoided in Section I4T41 by using [15] . 

5.2. Hyperelliptic curves of genus three 

In this section, let p > 3 and consider the moduli space V^o H H.3 of hyperelliptic 
curves of genus g and p-rank 0. By [TBI Thm. 5.12(4)], there exists Y G H3 which 
is supersingular with ay = 1 (and fy = 0). Then Jy[p] = I3 by Lemma 13. II This 
implies that the generic point of at least one component of V^o H 7i s has group 
scheme I3. However, the inductive argument in this paper requires information 
about every component. 

Here are some open questions whose solution would yield further progress. 

Question 5.1. Is V^o 7^3 irreducible? 

If p = 3, then 14,0 H H3 is irreducible by Prop. 3.5]. Using this, the authors 
prove Conjecture 13.61 for Vg^-3 (~l H g when g > 3 and p = 3. There do not seem to 
be any results about the number of components of V^o fl H.3 when p > 5. 

Question 5.2. How does T^p H H3 intersect the supersingular locus of H3I 

This relates to Coniecture l3.6l because every component of V^on?^ has Newton 
polygon G\ t 2 + G^i (three slopes of 1/3 and three slopes of 2/3) [16j Thm. 1.12]. 
However, this Newton polygon cannot distinguish between the group schemes ^3 
and 73,2, which have a- numbers 1 and 2 respectively. Here is some further evidence 
of the difficulty in comparing Newton polygons with p-torsion group schemes: if 
J x [p] = ^3, then the Newton polygon of X is typically + but by (16j Thm. 
5.12 (2,4)] it can also be 3Gi,i (supersingular). 

Question 5.3. If p > 5, is the p-rank of the generic point of each two-dimensional 
component of H.3 n T 3 ^ 2 equal to 1? 

The condition p > 5 is included here since H.3 is empty when p = 3. When 

p = 5, the authors of [5] show that H.3 fl T32 has a unique irreducible component 
of dimension 2, and that the generic point of this component has p-rank 1. Thus, 
no component of V3.0 fl H.3 can be contained in T g _2- As a result, the authors prove 
Conjecture 13.61 for V g . g -3 fl H g when g > 3 and p = 5. 

5.3. Hyperelliptic curves when p — 2 

The next results show that the hypothesis p > 3 in necessary for the hyperelliptic 
case of Conjecture 13.61 A version of Lemma HT4l is stated without proof in [22j 3.2]. 

Lemma 5.4. Let p = 2. Let X e V gfi n H g . Then a x = [(g + 1)/2J . 
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Proof. If X £ Vgfi fl Tig, then X has an Artin-Schreier equation y 2 — y = f(x) for 
some f(x) G k[x] with deg(/) = 2g + 1. A basis for H°(fli) is {x b dx | < b < g}. 
The action of V on Jx[p) is the same as the action of the Cartier operator C on 
H°(fli). By definition (see, for example, [UJ Prop. 2.1]) the Cartier operator acts by 
C{x b dx) = if b is even and C{x b dx) = x^'^^dx if b is odd. So v a = dim^tf^ ) = 
#{6 = 1 mod 2\0<b<g}=\(g- l)/2] . Then a x = g - v g = [(g + 1)/2J . ' □ 

The next example shows that Conjecture 13.61 is false for H3 f) V34 when p = 2. 

Example 5.5. Let p = 2, g = 3, and / = 1. Then 7^3 V^i has two components Fi 
and r 2 , each of dimension 3. Each curve X in Ti has an Artin-Schreier equation of 
the form y 2 —y = x +cix a + C2X + c^/x. A basis for H°(fli, X) is {dx/x, dx, xdx}. 
The Cartier operator acts by C(dx/x) = dx/x, C(dx) = and C{xdx) = dx. Thus 
ax = 1 if X G Fi. Each curve X in T2 has an Artin-Schreier equation of the form 
y 2 -y = x 3 + cix + c 2 /x + c 3 /x 3 . A basis for H°(fli,X) is {dx/x 2 , dx/x, dx}. The 
Cartier operator acts by C{dx/x 2 ) — 0, C(dx/x) = dx/x and C(dx) = 0. Thus 
ax = 2 if X G r 2 . So Conjecture 13.61 is false for the component T 2 . 

Remark 5.6. In [15 , for k = F 2 a, the authors calculate the number of k- 
isomorphism classes of hyperelliptic curves of genus 3 with a given Newton polygon. 
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